Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(client): remove needless process_output in process_input #1922

Draft
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

mxinden
Copy link
Collaborator

@mxinden mxinden commented Jun 13, 2024

There is no need to call process_output within process_multiple_input after each GRO datagram batch. Instead, process all available incoming datagrams in process_multiple_input and then move on to the top of the loop, calling handler.handle and then process_output` as usual.

…ultiple_input

There is no need to call `process_output` within `process_multiple_input` after
each GRO datagram batch. Instead, process all available incoming datagrams in
`process_multiple_input` and then move on to the top of the `loop`, calling
`handler.handle` and then process_output` as usual.
Copy link

github-actions bot commented Jun 13, 2024

Failed Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

All results

Succeeded Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Unsupported Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Copy link

codecov bot commented Jun 13, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.32%. Comparing base (f801c29) to head (6310058).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1922      +/-   ##
==========================================
- Coverage   95.36%   95.32%   -0.04%     
==========================================
  Files         112      112              
  Lines       36475    36475              
==========================================
- Hits        34784    34771      -13     
- Misses       1691     1704      +13     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

github-actions bot commented Jun 13, 2024

Firefox builds for this PR

The following builds are available for testing. Crossed-out builds did not succeed.

@mxinden mxinden marked this pull request as ready for review June 18, 2024 08:40
@mxinden
Copy link
Collaborator Author

mxinden commented Jun 18, 2024

Let's wait for a benchmark run before merging here. Just to make sure nothing depends on the additional calls to process_output.

@larseggert
Copy link
Collaborator

@mxinden the RPS bench seems to just sit there idle.

@larseggert
Copy link
Collaborator

@mxinden anything I can do to help land this?

@mxinden
Copy link
Collaborator Author

mxinden commented Jul 1, 2024

I suggest we land #1929 first. Might resolve the RPS benchmark stall.

@larseggert
Copy link
Collaborator

Pulled in from main w/#1929. Let's see.

Copy link

github-actions bot commented Jul 2, 2024

Benchmark results

Performance differences relative to f801c29.

coalesce_acked_from_zero 1+1 entries: 💔 Performance has regressed.
       time:   [196.50 ns 196.94 ns 197.42 ns]
       change: [+1.4264% +1.7729% +2.1298%] (p = 0.00 < 0.05)

Found 15 outliers among 100 measurements (15.00%)
8 (8.00%) high mild
7 (7.00%) high severe

coalesce_acked_from_zero 3+1 entries: Change within noise threshold.
       time:   [237.30 ns 237.95 ns 238.68 ns]
       change: [+0.0076% +0.3098% +0.6237%] (p = 0.05 < 0.05)

Found 14 outliers among 100 measurements (14.00%)
3 (3.00%) low mild
11 (11.00%) high severe

coalesce_acked_from_zero 10+1 entries: No change in performance detected.
       time:   [236.99 ns 237.78 ns 238.71 ns]
       change: [-0.3228% +0.1272% +0.5887%] (p = 0.60 > 0.05)

Found 9 outliers among 100 measurements (9.00%)
2 (2.00%) low severe
1 (1.00%) high mild
6 (6.00%) high severe

coalesce_acked_from_zero 1000+1 entries: Change within noise threshold.
       time:   [217.87 ns 218.04 ns 218.24 ns]
       change: [+0.8314% +1.6348% +2.3818%] (p = 0.00 < 0.05)

Found 11 outliers among 100 measurements (11.00%)
4 (4.00%) high mild
7 (7.00%) high severe

RxStreamOrderer::inbound_frame(): Change within noise threshold.
       time:   [119.42 ms 119.49 ms 119.56 ms]
       change: [+0.6544% +0.7456% +0.8354%] (p = 0.00 < 0.05)

Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild

transfer/pacing-false/varying-seeds: No change in performance detected.
       time:   [41.586 ms 43.487 ms 45.420 ms]
       change: [-2.9314% +3.0552% +9.3095%] (p = 0.34 > 0.05)

Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild

transfer/pacing-true/varying-seeds: No change in performance detected.
       time:   [54.106 ms 56.987 ms 59.880 ms]
       change: [-4.7970% +3.1800% +11.223%] (p = 0.41 > 0.05)
transfer/pacing-false/same-seed: No change in performance detected.
       time:   [49.179 ms 50.640 ms 52.065 ms]
       change: [-3.9362% +0.2231% +4.9892%] (p = 0.92 > 0.05)

Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild

transfer/pacing-true/same-seed: No change in performance detected.
       time:   [72.312 ms 79.005 ms 85.619 ms]
       change: [-4.3396% +9.0694% +23.600%] (p = 0.18 > 0.05)
1-conn/1-100mb-resp (aka. Download)/client: 💚 Performance has improved.
       time:   [140.16 ms 140.87 ms 141.67 ms]
       thrpt:  [705.86 MiB/s 709.89 MiB/s 713.45 MiB/s]
change:
       time:   [-19.713% -18.704% -17.687%] (p = 0.00 < 0.05)
       thrpt:  [+21.488% +23.007% +24.553%]

Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) high mild
5 (5.00%) high severe

1-conn/10_000-parallel-1b-resp (aka. RPS)/client: 💔 Performance has regressed.
       time:   [429.69 ms 432.06 ms 434.38 ms]
       thrpt:  [23.021 Kelem/s 23.145 Kelem/s 23.272 Kelem/s]
change:
       time:   [+4.2016% +5.2442% +6.3452%] (p = 0.00 < 0.05)
       thrpt:  [-5.9666% -4.9829% -4.0321%]
1-conn/1-1b-resp (aka. HPS)/client: No change in performance detected.
       time:   [46.978 ms 47.244 ms 47.509 ms]
       thrpt:  [21.049  elem/s 21.167  elem/s 21.287  elem/s]
change:
       time:   [-1.3336% +0.3260% +2.0086%] (p = 0.70 > 0.05)
       thrpt:  [-1.9691% -0.3249% +1.3516%]

Client/server transfer results

Transfer of 33554432 bytes over loopback.

Client Server CC Pacing Mean [ms] Min [ms] Max [ms] Relative
msquic msquic 221.2 ± 98.6 107.5 455.8 1.00
neqo msquic reno on 298.3 ± 59.6 253.1 455.6 1.00
neqo msquic reno 290.8 ± 61.4 245.4 460.5 1.00
neqo msquic cubic on 280.4 ± 41.0 254.0 393.9 1.00
neqo msquic cubic 299.4 ± 79.6 251.8 463.4 1.00
msquic neqo reno on 186.5 ± 76.6 105.4 360.7 1.00
msquic neqo reno 194.2 ± 82.1 115.8 375.3 1.00
msquic neqo cubic on 238.7 ± 83.6 166.3 400.9 1.00
msquic neqo cubic 259.6 ± 86.9 164.7 405.4 1.00
neqo neqo reno on 279.4 ± 286.4 163.9 1359.9 1.00
neqo neqo reno 249.8 ± 124.0 136.3 589.4 1.00
neqo neqo cubic on 249.8 ± 219.1 164.8 1019.8 1.00
neqo neqo cubic 219.3 ± 75.9 153.4 390.9 1.00

⬇️ Download logs

@mxinden
Copy link
Collaborator Author

mxinden commented Jul 2, 2024

Pulled in from main w/#1929. Let's see.

All green. Good news 😮‍💨

@mxinden
Copy link
Collaborator Author

mxinden commented Jul 2, 2024

1-conn/1-100mb-resp (aka. Download)/client: 💔 Performance has regressed.

   time:   [1.7535 s 1.8771 s 1.9494 s]
   thrpt:  [51.297 MiB/s 53.273 MiB/s 57.028 MiB/s]

change:
time: [+52.443% +65.455% +73.749%] (p = 0.00 < 0.05)
thrpt: [-42.446% -39.561% -34.402%]

Let's hold off merging for now.

@larseggert
Copy link
Collaborator

OK, making this a draft PR for now.

@larseggert larseggert marked this pull request as draft July 3, 2024 05:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants